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Abstract — We investigate the possibility of using different 
chaotic sequences to construct measurement matrices in compres- 
sive sampling. In particular, we consider sequences generated by 
Chua, Lorenz and Rossler dynamical systems and investigate 
the accuracy of reconstruction when using each of them to 
construct measurement matrices. Chua and Lorenz sequences 
appear to be suitable to construct measurement matrices. We 
compare the recovery rate of the original sequence with that 
obtained by using Gaussian, Bernoulli and uniformly distributed 
random measurement matrices. We also investigate the impact of 
correlation on the recovery rate. It appears that correlation does 
not influence the probability of exact reconstruction significantly. 

Index Terms — Compressive sampling, Chaos, Correlation. 

I. Introduction 

ACCORDING to the Nyquist-Shannon sampling theorem, 
if a signal is band limited to a bandwidth B, then it 
is completely determined by sampling it at discrete times, 
provided that the sampling rate is at least equal to 2B. The 
original continuous-time signal can be reconstructed from the 
discrete-time samples via an interpolation process achieved 
with a low-pass filter. 

Recently, work by Candes (TJ, Donoho (2), and others 
demonstrated that it is possible to exactly reconstruct some 
signals from undersampled data. If a signal is sparse in 
the original domain, or some transform domain (sparsifying 
domain), meaning that it does not have many features, we 
can take far fewer measurements and utilize knowledge of the 
structure of the signal to infer the rest. Thus, we can exactly 
reconstruct sparse signals with far fewer measurements than 
needed by Nyquist - Shannon theory. 

This approach to sub-Nyquist sampling has been called 
compressive sampling (CS). Nice overviews of compressive 
sampling can be found in |3|, |4|. 

The idea of CS is to combine the two stages, sampling 
and compression. Measurements of the signal are taken using 
the measurement matrix, which is supposed to be incoherent 
with the matrix describing the sparsifying transform. More 
formally, the so called Restricted Isometry Property (RIP) 
should be met. Since random signals are incoherent with 
almost anything, taking iid samples from a random distribution 
(for example, Gaussian or uniform) to create the measurement 
matrix, violates the RIP property with exponentially small 
probability. 



Since chaotic signals exhibit similar properties to random 
signals, some authors have attempted using chaotic signals to 
construct the measurement matrix. 

In the authors continue on the work in |6l on random 
filters in CS, and examine the use of chaos filters in CS with 
filter taps calculated from the Logistic map. The authors claim 
that their numerical simulations indicate that chaos filters 
generated by the Logistic map outperform random filters. 

In (7) the authors construct the measurement matrix with 
chaotic sequence from Logistic map and prove that, with 
overwhelming probability, the RIP of this kind of matrix is 
satisfied, which guarantees exact recovery. The authors exper- 
imentally show that chaotic matrix has similar performance 
to the Gaussian random matrix and sparse random matrix. 
In the subsequent work [8), the authors show that Toeplitz- 
structured measurement matrix constructed using a chaotic 
sequence is sufficient to satisfy RIP with high probability. This 
measurement matrix can be easily built as a filter with a small 
number of taps. 

To the best of our knowledge in the literature on using 
chaotic sequences in CS, chaotic maps other than the Logistic 
map have not been used. Also, in the literature it is usually 
assumed that the chaotic sequence should be uncorrelated, 
and, therefore, every d-th sample is used to create the mea- 
surement matrix, where d is such to ensure that the samples 
are uncorrelated. Although the performance of Logistic map 
has been shown to be very satisfactory and sometimes to 
outperform the performance using random matrices, such as 
Gaussian, Bernoulli or uniform, it is still desirable to examine 
and compare the performance of other chaotic maps. 

Therefore, in this paper we address the following questions: 

- Which chaotic signals can be used to construct measuring 
matrices? 

- Does the correlation influence the probability of exact 
reconstruction significantly? 

- How does the performance of chaos-based measurement 
matrices compare to the performance of random measurement 
matrices? 

In Section [TT] we give a brief overview of compressive 
sampling. Section QTI] gives a brief overview of nonlinear 
dynamical systems that exhibit chaotic behaviour, and depicts 
the properties of three chaotic systems whose applicability in 
CS is examined. The main results of this work are presented 
in Section [TV] Section [V] concludes the paper. 
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II. Compressive sampling 

Compressive sampling answers the question if we can 
compress the signal x 6 into some compressed basis 
where it can be represented sparsely as a signal s, then can we 



recover the original signal if the number of measurements M is 
approximately equal to the number of significant components 
of s? If our sparse signal s is fc-sparse, meaning it has 
fc significant components, we can fix our solution for s in 
k dimensions, and do some kind of optimization for the 
remaining N — k elements. Mathematically, the measured 
samples are given by 

y = $x = $vT/s = 9s (1) 

where $ is the measurement (sensing) basis, ^ is the com- 
pression basis, and = Q'fy is the compressive sensing matrix 
and is the product of the compression and measurement bases. 
So, we can take some small number of samples y, compute 
the sparse representation s of our exact signal x, and then 
apply the inverse compression approximation to recover x. 

Important property that $ and should meet is incoher- 
ence. The coherence measures the largest correlation between 
any two elements of $ and "J. If $ and ^ contain correlated 
elements, the coherence is large. Otherwise, it is small. Math- 
ematically, coherence is defined as, 

= VN max \(i> k ,<f>j)\ (2) 

l<k,j<N 

This function takes on values between 1 and y/N. 

To guarantee that the compressive sensing matrix is 
stable, it must meet the Restricted Isometry Property (RIP): 

(l-S k )\\s\\l<\\e S \\l<(l + S k )\\s\\l (3) 

In other words, must be a distance preserving transformation 
for all fc-sparse vectors x, bounded by some constant 5 k , 
known as the restricted isometry constant. When this property 
holds, all fc-subsets of the columns of are nearly orthogonal. 
If this property does not hold then it is possible for a fc-sparse 
signal to be in the null space of and in this case it may be 
impossible to reconstruct these vectors. 

It has been shown that bases $ and ^ which are incoherent 
will satisfy RIP. 

Regarding the reconstruction algorithms, different norms 
can be used. The l 2 norm does not favor a sparse solution 
and has been shown that cannot be used. The lo norm counts 
the number of zeros in the vector, and that's exactly what we 
want to minimize. But, it turns out that we would have to try 
every combination of zeros to find the solution, which is NP- 
hard, and thus intractable. The researchers that worked in the 
CS area discovered that we can solve the problem using the 
li norm and obtain exact results. 

III. Chaotic dynamical systems 

Nonlinear dynamical systems are capable of exhibiting 
chaotic behavior for certain parameter values. Chaotic behav- 
ior exhibits exponential sensitivity to small changes in initial 
conditions: two chaotic trajectories starting from arbitrarily 
close initial conditions will eventually diverge from each 
other. Thus, even the smallest error in the measurement of 
initial conditions of a chaotic dynamical system precludes 
us from predicting its long term behavior. Despite their de- 
terministic definition e.g. via ordinary differential equations, 
chaotic dynamical systems exhibit unpredictable behaviour. 



This duality in the nature of chaotic dynamical systems have 
sparked an immense interest in their potential applicability in a 
wide range of areas: cryptography, telecommunications, traffic 
modelling, medicine etc. Using chaotic dynamical systems for 
random number generation is a well researched area J9)- In 
this section we present the properties of three well-known 
chaotic dynamical systems which are relevant for generation 
of elements of measurement matrices in CS. 

A. Chua 

Properties of chaotic behaviour will be illustrated via an 
example based on Chua's circuit which is the simplest elec- 
tronic circuit capable of exhibiting chaos. Besides its sim- 
plicity, it is particularly useful and interesting because its 
chaotic behaviour has been proven analytically, numerically 
and experimentally which has not been accomplished for many 
other circuits. 

In numerical simulations, one often exploits the following 
dimensionless form of Chua's circuit 

x = [a(x 2 - X! - g{x 1 )),x 1 -x 2 + x 3 , -f3x 2 ] T (4) 

where g(xi) = bx\ + \{a — b)\\X\ + 1| — \xi — 1|]. For the 
following parameter values a = —1.27, b = —0.68, a = 10.0, 
/3 = 14.87 Chua's circuit exhibits chaotic behaviour. 

The chaotic attractor of Chua's circuit for the previous 
parameter values is widely known as the double-scroll chaotic 
attractor. As an indication of the randomness of chaotic 
trajectories we show in Fig. Q] the normalised autocorrelation 

Rx u norm(r) = R Xi {t)/R Xi (0) 
of the signal x\ it) generated by Chua's circuit ©, where 

1 r T ' 2 

R Xi (t)= lim - / xxit + ^x^dt. 

Figure Q] reveals rapid decorrelation between close samples, 
thus making this sequence akin to a random trajectory. 
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Fig. 1 . Autocorrelation of the chaotic signal generated by Chua's circuit. 

Figure [2] shows the probability density function of the 
chaotic signal x\{t) generated by Chua's circuit (0|. 

B. Lorenz 

We have numerically examined the Lorenz system 

x= [16.0(x2 — x\), 45.6x1 — xi%3 — x 2 , X\x 2 — 4.0cc3] T . (5) 

Correlation between samples decreases rapidly with the 
sampling distance, as shown in Figure [3] 

Figure [4] shows the probability density function of the 
chaotic signal xi(t) generated by Lorenz system (0. 
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Fig. 2. Probability density function of the chaotic signal generated by Chua's 
circuit. 




Fig. 3. Autocorrelation of the chaotic signal generated by Lorenz system. 

C. Rossler 

We have also analysed the Rossler system 

x = [-x 2 - x 3 , xi + 0.2aj 2 , 0.2 + ar 3 (a;i - 5.7)] T . (6) 

However, Rossler system spends a significant portion of 
the time making loops in the x\ — x-i plane around the 
origin and spiralling outwards. As x\ approaches value 5.7, 
£3 starts to climb. This growth in £3 makes x\ to drop and 
the spiraling motion in the x\— X2 plane starts again. This long 
spiraling motion causes strong periodic correlation in x\{t). 
Consequently, unless very long sampling period is employed, 
generated sequences of numbers will be statisticaly dependent 
and the resulting chaos filters will not be useful for signal 
acquisition and reconstruction in compressed sensing. This 
indicates that due attention needs to be paid to the choice of 
the chaotic dynamical system used in compressive sampling. 

IV. Main results 

In this section we explain how we use chaotic signals to 
sample sparse signals. We compare their performance to the 
performance when sampling is done by random measurement 
matrices. We also investigate the impact of correlation in the 
measurement sequence, chaotic or random. 

As an input sequence we use time-sparse signals: k spikes 
G {— 1,+1} randomly set in a sequence of N samples, with 
equal probability of — l's and l's. A Bernoulli sequence of 
total of k —l's and l's with probability 0.5 is generated by 
using Monte Carlo simulation. Then N — k zeros are added 
at the end of this sequence. Finally, the obtained sequence of 
length N is randomly permuted. 

Next we explain the process of construction of the mea- 
surement matrix $ G R MxN . The procedure is the same for 
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Fig. 4. Probability density function of the chaotic signal generated by Lorenz 
system. 



both random signals and chaotic signals. We first generate a 
sequence c = [cq, ci, . . . , cmn-i] of length M x N and then 
we construct a matrix of size M x N columnwise (taking M 
contiguous samples and putting them in a column of 

All elements of the matrix are scaled with the factor 
l/(cry/~M) where a 2 is the variance of the sampled signal 
(or sequence) used to construct the measurement matrix. Thus 



$ = 



1 



Co 

Cl 



cm 
cm+i 



c M{N-l) 
C M(N-1) + 1 



CM-1 C2M-1 ■ ■ • CMN-1 

The vector of measurements y G R is obtained as 

V = $x 



(7) 



(8) 



The problem of reconstruction can be stated formally as: 



mm 

s£R N 



|s||i subject to y = 9s 



(9) 



This is a well-established problem known as basis pursuit. 
Basis pursuit problems can be easily transformed into a linear 
programming problem. 

In our simulations we used the primal-dual interior point 
algorithm, whose Matlab implementation can be found here: 
http://www-stat.stanford.edu/^candes/software.html under LI 
MAGIC. It requires as an input the initial guess x for the 
solution, the measurement matrix $, the measurements y, and 
the precision to which we want the problem solved. 

We performed extensive simulations with various measure- 
ment matrices. We used two continuous time chaotic dynam- 
ical systems for creating the elements of the measurement 
matrix: Chua's circuit and Lorenz system. For Chua's circuit 
we sampled x\ at sampling distance r = 1, while for Lorenz 
system we sampled x\ at sampling distance r = 0.5. 

We also used several random measurement matrices, ob- 
tained from sequences such as iid Gaussian, Gaussian with 
autocorrelation R(i) = p^, i G Z (we used p = 0.99), 
Bernoulli, iid uniform in the range [0, 1] and iid uniform in 
the range [-0.5,0.5]. 

Figure depicts the dependence of the probability of in- 
correct reconstruction on the signal sparsity k when N = 100 
and M = 50. As a criterion for exact reconstruction we used 
that the relative error e is smaller than e = 0.01 



x < 



0.01 



(10) 



where x r is the reconstructed vector and || • || is the I2 norm. 

As depicted in Fig. |5J there are no significant differences in 
the performance of diferent measurement matrices. This is de- 
spite the significant normalised autocorrelation -R^.normt^ = 
1) = 0.47 for Chua's circuit ©. 

Gaussian sequence with correlation 0.99 also did not exhibit 
any noticeable performance loss. We should keep in mind 
that since the elements of the measurement sequence are 
written columnwise in matrix $, the correlation is significantly 
decreased (the adjacent elements in each row come from 
elements in the sequence that are M samples apart). 
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Fig. 5. Probability of incorrect reconstruction Pr{e = ||x — x,-||/||x|| > 
£ = 0.01} as a function of the signal sparsity k for N = 100 and M = 50. 

Maximum sparsity k max which allows for correct recovery 
of x does not depend on the measurement matrix, and is solely 
determined by N and M. Figure [6] depicts the dependence 
of the maximum sparsity k max on the ratio r — N/M for 
e = 0.01. k max is determined as the maximum sparsity for 
which error rate is smaller than 0.1. Linear interpolation is 
used to determine k max . If M is doubled, then k max increases 
roughly by factor 2.1 for each N. 
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Fig. 6. Dependence of k ma x on N/M. 

Figure [7] depicts histograms of the logarithm of the relative 
error between original and recovered signal e = ||x— x r ||/||x|| 
for fixed N = 100 and M = 50, and for various k, obtained 
from 5, 000 simulation runs. When the original signal is 
correctly recovered, then a small but finite error e occurs due to 
the finite precision to which the optimization problem is solved 
by the LI MAGIC algorithm. If the recovery is incorrect, 
then a large relative error occurs. Consequently, wide range 
of values of e E [10~ 2,5 , 10~ ' 5 ] can distinguish between the 
correct and incorrect recovery. 




Fig. 7. Histograms of the logarithm of the relative error e = | x — x r 1 1 / 1 |x| | . 
(a) k=ll; (b) k=16; (c) k=20; (d) k=25 



V. Conclusion 

We studied the use of different chaotic signals to construct 
measurement matrices in compressive sampling. We showed 
that Chua and Lorenz chaotic signals show performance com- 
parable to that of random Gaussian, Bernoulli and uniformly 
distributed sequences. We determined that the correlation 
does not increase the probability of incorrect reconstruction. 
The performance is relatively insensitive on the value of the 
parameter e used to test the exact reconstruction. 
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